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(57) Abstract 



A method and apparatus for detecting colinear edge points and 
measuring the distance between two edges in a digitized image. An im- 
age is captured (16) and digitized (20). The pixels corresponding to 
edge points are identified and processed to select colinear edge points 
by finding the straight line passing through the maximum number of 
edge points. The search for this line is performed by starting with an 
expected slope value (14a) and varying the slope by an amount corre- 
sponding to a predetermined angular increment For each test slope, 
the y-intercepts are calculated (15a) for the straight lines passing 
through each edge point, and the best slope/intercept pair is deter- 
mined. The points lying on or near the line defined by the best slope/ 
intercept pair are selected and used to generate a straight line. The pro- 
cess is repeated for two edges and the distance between the two lines is 
measured. 
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5 METHOD AND APPARATUS FOR AUTOMATED MEASUREMENT 

OF LOCATION AND SEPARATION OF LINEAR EDGES 

OTICE BES&BBIHS CttPYRTPqTEP MATERIAL 

A portion of the disclosure of this patent 
10 document contains material which is subject to copyright 

protection. The copyright owner has no objection to the 
facsimile reproduction by anyone of the patent document 
or the patent disclosure, as it appears in the Patent and 
Trademark Office patent file or records, but otherwise 
15 reserves all copyright rights whatsoever. 

BftCKgRQWP Of TOE IMYENTIQN 

This invention relates generally to the field 
of automated measurement techniques and, more 
20 specifically, it relates to a method and apparatus for 

detecting collinear edge points in a digitized image and 
measuring the distance between two virtually parallel 
edges. 

In many applications, it is necessary to 
25 measure the distance between two straight lines. For 

example, the measurement of the width of a strip of 
material on a semiconductor device may require a 
measurement of the distance between the substantially 
parallel edges. For another example, registration of two 
30 layers of a semiconductor product may be accomplished by 

aligning two images of known rectangular dimension, which 
< requires a measurement of the distance between several 

> pairs of parallel horizontal and vertical lines. 

Automated systems exist for performing these 
35 measurements by capturing eld image of the device, 
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digitizing the image, and analyzing the digitized image. 
The analysis of the image requires identifying the points 
in the image which represent the edges, "fitting" a 
straight line to each edge, and then determining the 
5 separation between the two lines. 

The process of fitting a line to the edge 
points is complicated by the fact that, regardless of the 
method used to identify the edge points, there will be 
some points that do not correspond to the "true" line. 

10 These points are caused by noise in the image, dirt on 

the article being measured, or imperfections (bumps) on 
the edge. Known line-fitting methods, such as the 
ordinary least squares method, will produce a line which 
is a "best" fit to all of the points, but which, because 

15 of the inclusion of non-coil inear points, can be an 

inadequate representation of the "true 11 line. 

There are other methods, based on the Hough 
Transform disclosed in U.S. Patent No. 3,069,654, which 
detect collinear points by mapping the image points into 

20 lines in slope/ intercept space. The slope/intercept 

space is quantized into cells, and the cell with the 
maximum number of lines passing through it corresponds to 
the slope and intercept of the straight line through the 
collinear points. The utility of this method is limited 

25 by the unbounded nature of the possible slope and 

intercept values, and the method does not work well at 
all for the common case of vertical lines, where the 
slope is infinite. An improvement on this method uses an 
angle-radius parameterization, thereby avoiding the 

30 problem of the unboundedness of the slope. Each point 

(x,y) in the image is mapped into a sinusoidal curve in 
angle-radius space defined by the equation: 

p = x cos 0 + y sin 0, where 0 < e < rr. 
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Such mapping requires large amounts of computational 
resources because it requires repeated calculation of 
transcendental trigonometric functions. 

SUMMARY OF THE INVENTION 

The invention provides a method and apparatus 
for detecting collinear edge points and measuring the 
distance between two edges in a digitized image without 
repeated calculation of transcendental functions. An 
image is captured and digitized. The edge points in the 
digitized image are identified and processed to select 
collinear edge points by finding the straight line 
passing through the maximum number of edge points. The 
search for this line is performed by starting with an 
expected slope value and varying the slope by an amount 
corresponding to a predetermined angular increment. For 
each test slope, the y-intercepts are calculated for the 
straight lines passing through each edge point, and the 
best slope/ intercept pair is determined. The points 
lying on or near the line defined by the best slope/ 
intercept pair are selected and used to generate a 
straight line. The process is repeated for two edges and 
the distance between the two lines is measured. 

A thorough understanding of this invention will 
be provided by the following description of the preferred 
embodiment and the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of an apparatus for 
practicing the invention; 

Figs. 2A-2B are a flow chart of the method used 
in the preferred embodiment to process edge data; 

Fig. 3 is a diagram of an edge and the 
resulting grey scale representation thereof; and 
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Fig. 4A-4C are diagrams of trial slopes applied 
to edge points and the histograms resulting from these 
trials. 

5 DESCRIPTION OF THE PREFERRED EMBODIMENT 

Referring to Fig. 1, a system 10 for performing 
measurements according to the invention is shown. A 
microscope 12 is focused on an area of the subject, which 
in this application is a semiconductor wafer 14. A 

10 camera 16 captures an image from microscope 12 and passes 

the image in electronic form to an image digitizer 20. 
Digitizer 20 converts the image to an ordered array of 
digital picture elements (pixels) and transmits the 
digital data to computer 22 for processing. In this 

15 embodiment, each pixel is an 8-bit "grey-scale" 

representation of a portion of the area being viewed, 
with a value in the range 0-255. A keyboard 24 and a 
display screen 26 are coupled to computer 22 for input 
and output of parameters and commands. Computer 22, 

20 which in this embodiment is a general purpose computer 

using an 80386 processor and an 80387 math co-processor 
(both available from Intel Corp. of Santa Clara, 
California) , is coupled to control circuits 26. Control 
circuits 26 contain circuitry for controlling the 

25 parameters of the image capture system, such as focus, 

lighting (illumination) , magnification, wafer position, 
etc. 

The image obtained from microscope 12 and 
camera 16 is filtered and analyzed to determine the 

30 location, size and spacing of various features on 

semiconductor wafer 14 . Many of the features that are 
analyzed require measuring the distance between two 
straight edges. This is accomplished by determining 
where in the image the two edges are, fitting a line to 

35 each edge, and then determining the separation between 
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the two lines. The line fitting process results in a 
mathematical characterization of a line which 
approximates the true edge. 

Computer 22 analyzes the digitized image data 
to determine which pixels in the image correspond to 
points on an edge. Several edge-detection techniques are 
available for this purpose. In this embodiment, the 
pixels in each scan line are examined to determine the 
amount of contrast between adjacent pixels, i.e., the 
change in grey scale values. When the grey scale value 
crosses a predetermined threshold value with a 
predetermined amount of "rise" (gradient), this indicates 
a potential edge point. The threshold and rise amount 
can be calibrated for a particular application in 
accordance with the other viewing system parameters. The 
edge points are calculated to sub-pixel accuracy by 
interpolating between actual pixel coordinates. The 
resulting floating-point edge coordinates are stored in a 
list of edge points for further analysis. 

Regardless of the methods used for filtering 
the image and locating edge points, the points that are 
located will not be collinear; there is always some noise 
in the image. In extreme cases, the image can be 
corrupted by dirt on the wafer, by slight imperfections 
in the formation of the semiconductor features, or other 
problems. These non-collinear points can distort any 
attempt to find a line that corresponds to the "true" 
edge. The invention provides a method for compensating 
for imperfections and obtaining reliable, reproducible 
line fitting results. 

Referring now to Figs. 2A-2B, a flow chart 100 
illustrates the method for processing the edge point data 
to find the line which best represents the true edge. 
The method illustrated in Figs. 2A-2B is implemented by 
the computer program supplied herewith as Appendix A, 
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which is executed on the computer system shown and 
described hereinabove with reference to Fig. 1* The 
computer program is written in the n C M programming 
language. In the following discussion, reference will be 

. 5 made to specific portions of the program, to enable a 

precise, understanding of the preferred embodiment of the 
present invention. It will be understood, however, that 
those skilled in the art could implement this invention 
in many forms, including other programming languages or 

10 in hardware logic circuitry. 

The input to the computer program of Appendix A 
is the floating point edge data, representing each edge 
point by its x-y coordinates. The output will be the 
slope and y-intercept defining a line according to the 

15 equation y = mx + b, along with a verification percentage 

for the line. The verification percentage is a measure 
of the proportion of the points which are on or close to 
the line. 

The data is analyzed in stages, by making a 
20 quick initial estimate of the line and determining 

whether further processing is required. If the initial 
estimate is not sufficiently accurate, then the edge data 
is further analyzed to determine which points correspond 
to true edge points and which points correspond to noise 
25 or imperfections. Then a line is fit to the true edge 

points. 

Referring to Fig. 2A, in Step 110, the edge 
points are determined by the method described above. At 
Step 120, a standard "least squares 11 algorithm is applied 

30 to the edge point data to find the line which is the 

"best* fit to all of the supposed edge points. All of 
the edge points sure included in this calculation. In the 
common case, where all of the edge points are "good" 
(they are all essentially on a straight line) this method 

35 will yield a good fit. If however the line is corrupted 
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by a bump or a piece of dirt, then the line found by the 
least squares method will be off slightly from the true 
edge. Therefore, in Step 130, the RMS error found by the 
least squares method is tested. If the RMS error is less 
than .5 pixels, then the edge data is assumed to be good 
and no further processing is performed, if the RMS error 
is in an intermediate range (.5 to 1.5 pixels), then at 
step 135 a verification percentage is calculated for the 
least squares line. The verification percentage is a 
calculation of what percentage of the edge points fall 
within a given distance (closer than 1.5 pixels) of the 
fitted line. If the verification percentage is more than 
90%, then no further processing is required. Of course, 
the variables used to determine whether more processing 
is required (the high and low RMS error, the verification 
percentage and the verification distance) can be adjusted 
for best results for a particular application. If the 
two tests applied in Steps 130 and 135 are both failed, 
this indicates that there are some bad points in the edge 
point data which do not correspond to the true edge. The 
edge data is further analyzed to determine which edge 
points correspond to the true edge and which correspond 
to noise or imperfections. 

The selection of M true w (substantially 
collinear) edge points is performed by finding the slope 
and intercept of a line which has the maximum number of 
edge points on it. The line is then used as a basis for 
selecting the points to be used to fit the final line. 

Referring to Fig. 2B, the details of this 
selection method are shown. At Step 140, an initial 
guess is made at the slope of the line, in many 
applications, such as registration of layers of 
semiconductors, it is known in advance what the expected 
slope of the edge is. This expected slope will be used 
as the first trial slope. First, however, the edge data 
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is converted to integer, .x-y pixel values to speed up the 
calculation. An n x 4 array ("EDGE") is created, where n 
is the number of edge points. The columns of the EDGE 
array will store the x pixel value, the y pixel value, a 
5 y- intercept value and a flag. 

At Step 150, the trial slope is used to 
calculate, for each point, the y- intercept of a line 
having the trial slope and passing through the point. 
By describing the line in the standard slope, intercept 
10 fashion: 

y = mx + b 

then the y-intercept of a line passing through the point 
15 x,y and having slope m can be calculated as: 

b = y - mx 

The resulting y-intercept is stored in the EDGE array. 

20 A histogram is constructed of the y- intercepts 

of lines passing through each edge point and having slope 
equal to the trial slope. The y-intercept values are 
quantized into "bins" one pixel wide, and each bin 
contains the number of edge points on the corresponding 

25 line. The count of edge points in the histogram bin 

containing the most edge points is selected as the peak 
value for this trial slope. 

At Step 160, a new trial slope is selected. 
The angle (0) of the expected slope is calculated using 

30 the inverse tangent function. The angle is incremented 

in a first direction by a predetermined amount (to the 
left by .5 degrees, in this embodiment). The tangent of 
the new angle is calculated to determine the next trial 
slope. The y-intercepts of the lines having the new 

35 slope and passing through each point are calculated, a 
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histogram is constructed, and the bin with the most 
points is determined. If the maximum number of points is 
greater than the previous maximum, then the search 
continues in the same direction, with the slope being 
5 incremented by an amount corresponding to .5 degrees in 

that direction. The search continues in the first 
direction until either: a) the angle reaches a 
predetermined limit; or b) the maviim m number of pixels 
found in a bin has decreased for n consecutive tries 
10 (n * 4 in this embodiment) . The search then proceeds in 

the other direction until one of these conditions is met. 
At Step 170, the trial slope corresponding to the 
histogram with the highest peak is selected as the best 
slope. 

15 A subroutine for performing the search for the 

best slope (i.e. the slope of the line with the most 
pixels on it) is given in Appendix A as the function 
slope_search. The variables ANG_INC , ANGJiAX and 
LXMIT_TBST determine the angular increment for the 

20 search, the maximum angle from the expected slope angle, 

and the number of times the result must decrease for the 
search to stop, respectively. These parameters may be 
varied for the best results in a particular application. 
It will be noted that in the subroutine 

25 slope_search, the start_ang variable is calculated once 

from the expected slope using the arctangent function. 
The slope for each new test is calculated once for each 
test using start_ang, an increment, and the tangent 
function before the call to subroutine match_slope. The 

30 invention thus increases computational efficiency by 

minimizing the use of transcendental functions. This is 
in contrast to the prior art methods which use angle- 
radius coordinates, requiring repeated calculation of 
trigonometric functions. Such methods were developed in 

35 response to earlier methods which used the slope 
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intercept equation, where the slope is unbounded and does 
not provide a good independent variable for the search. 
The preferred embodiment of the present invention uses 
the angle of the slope as an independent variable, 
5 computes the slope using the tangent function, and 

computes the y- intercept value without requiring further 
calculation of transcendental functions. 

For each trial slope value, subroutine 
slope_search calls subroutine match_slope to accumulate 

10 the histogram for that slope. Subroutine match_slope 

computes the y-intercepts and calls subroutine histogram 
once for each value to enter the value into the 
histogram. Subroutine match_slope then finds the peak 
bin in the histogram for the trial slope and returns to 

15 subroutine slope__search for calculation of the next trial 

slope. Subroutine slope_search determines the peak value 
from all histograms and the slope corresponding to this 
peak value. Subroutine slope__search then makes one final 
call to subroutine match_slope to rebuild the histogram 

20 for the best slope. 

After the search is complete, the "peak" bin 
has been found, and the best slope has been determined, 
the histogram for that slope is further examined 
(Step 175) . For a given slope, all edge points whose 

25 y- intercept values are identical will lie on the same 

line. In practice, however, edge points that lie along 
the same line will not necessarily have identical y- 
intercepts, although they will be very close. It is 
likely that some of the good edge points will, because of 

30 noise, fall into bins immediately adjacent to the peak 

bin. Therefore, on the last call to subroutine 
matches lope, the peak bin and adjacent bins are examined 
and good edge points are selected and flagged. Starting 
with the peak bin of the histogram, either the left or 

35 right adjacent bin, whichever is higher, is added to the 
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selected points. This process continues until either: 
a) the total number of points selected exceeds a 
predetermined percentage (65% in this embodiment) of the 
total number of edge points; or b) the highest adjacent 
bin has less than 10% of the number of total edge points. 
In the latter case, the bin with less than 10% of the 
total is not selected. 

The selected points are flagged in the fourth 
column of the EDGE array. Preferably, an additional scan 
is made through the edge data and, if any point is not 
selected, than the adjacent points on both sides of that 
point are also marked as * l bad w . This takes care of the 
common case where edge data is good for a portion of the 
image and is then corrupted by dirt. The last edge point 
along the good portion of the line may be perturbed by 
the presence of dirt, but its data may still be good 
enough to have been selected. This final scan will throw 
out all such points that are adjacent to noisy areas, 
avoiding a small perturbation in the results. 

At Step 180, a final least squares line fit is 
performed, using only the selected points. It will be 
noted that although the selection of good edge points was 
performed with integer arithmetic, allowing the program 
to execute faster, the final line fitting calculation is 
now performed with floating point edge data. 

At Step 190, a verification percentage is 
calculated for the line obtained by the least squares 
fit. The verification percentage determines if the 
method was able to extract a valid line from the data. 
(It is possible, of course, that there is no valid line.) 
The verification percentage is a calculation of what 
percentage of the edge points fall within a given 
distance (1.5 pixels in this embodiment) of the fitted 
line. If the percentage falls below a limit (which may 
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be set by the user) , thetn the data iis rejected as too 
noisy. 

After the equations for the lines approximating 
the edges have been determined, the distance between the 
5 lines can be measured. If the slopes are not equal, the 

distance can be measured at the center point on each 
line. The resulting measurement can be displayed, 
directly or indirectly, on display screen 26 (Fig. 1) . A 
number may be displayed, or a graphical indication of the 

10 measurement may be displayed. In the semiconductor mask 

alignment application, several sites are visited on a 
wafer, measurements are performed, and a vector map is 
displayed, showing areas that are not properly 
registered, with a graphical indication of the amount of 

15 the error. 

Figs. 3-4 illustrate some typical results of 
the above-described method in operation. Fig. 3 
illustrates the grey scale scanlines generated from a 
camera scan of a straight edge with a bump. Fig. 4A 

20 illustrates the histogram 40 resulting from calculation 

of y-intercepts of lines passing through the edge data at 
the expected vertical slope 42. The bump in the material 
shows up as a small peak in the histogram at this slope. 
Fig. 4B illustrates the histogram 44 generated at a 

25 typical search slope 46. Fig. 4C illustrates the 

histogram 48 generated when the search slope 50 
corresponds to the actual slope of the edge. A very 
prominent peak in the histogram is generated when the 
actual edge slope is used. The bump is reflected in the 

30 histogram by small side lobes. The range of angles 

chosen for search slopes in Figs. 4A-4C has been 
exaggerated for purposes of illustration. 

A preferred embodiment of the invention has now 
been described. It will be understood, however, that 

35 many variations and modifications will be apparent to 
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those of ordinary skill. of the art informed by this 
disclosure. Further, there are many applications^ where 
the line detection aspects of the invention are useful 
even though a separation measurement is not required. 
All such applications, variations and modifications are 
well within the scope of the present invention, which is 
defined by the following claims. 



WO 92/11609 



PCT/US91/09477 



14 

/include "map-ch" 

/def ine LEFT 0 

/define RIGHT 1 

/define PI 3.14159265358979323846 

/define DEG2RAD (PI/ 180.0) 

/define ANG_INC (0.50*DEG2RAD) 
/define ANG_MAX (10.0*DEG2RAD) 
/define KEMIT_TEST 4 

/define X_CENTER 376 
/define Y_CENTER 240 

/define BAD_Y_INT 0x4 /* bad y_intercept */ 

/* VERIFY_DISTANCE is the distance in pixels that an edge point 

Can be 

from the calculated edge to count as a verification point */ 

#define VERIFY_DISTANCE 1.5 

/define TIGHT_RMS 0.5 
#define L00SE_RMS 1.5 
#define TIGHT VFY 0.90 

#define LOOSE_VFY 0.10 /* set way low for 

experimentation */ 

/* When match_slope ( ) analyzes the histogram to mark edge points 
for 

selection, it includes the max bin plus enough adjacent side 

bins 

so that SELECT_PCT of the edge points cure selected. If some 
almost 

empty bins are found before SELECTION_PCT is reached, then 

the 

selection process terminates immediately. This avoids 
including 

noise points in a very noisy picture. */ 

#define SELECTION_PCT 0.65 /* selection % expressed as a 
fraction */ 

/* EXTERNALS */ 

extern struct sys_rec_type sys_rec; 
extern struct meas_rec_type *measj?tr; 

/* GLORALS for this source file */ 

struct hnode { 

struct hnode *left; 
struct hnode *right; 
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int value; 
int count; 

}; 

static struct hnode far *hptr; 
static struct hnode far *hhead; 
static struct hnode far *htail; 
static struct hnode far *hist_alloc; 
static struct hnode far *hist_free; 

static double x_pix_siz; 
static double y_pix_siz; 

static int horiz_wind; 

/*********************************************************^ 
******** 

fit_line() — main entry point for new line fitting algorithms 

inputs: coords [] [2] — floating point edge data 
count — length of coords [] [2] 

outputs: slope — slope of line fit to edge points 

y_intercept — y_intercept of line fit to edge points 

return value: -1 out of memory 

0 normal return, line found 

1 line found, but loose verify only 

2 line not reliably found 

****4r**********************************************^* A ^*^ A «^^ 

********/ 

int fit_line( coords, count, slope, y_intercept) 
double coords[][2], 

*slope, 

*y_intercept ; 
int *count; 
{ 

void far *edge_alloc; 

unsigned int seg, ofs; 

unsigned long long_addr; 

int far (*edge)[4]; 

double expected_slope, rms, vfy_pct; 

int rc; 

char out_string[80] ; 

x_j>ix_siz = sys_rec.x_pixel[meas_ptr->obj_ntua] ; 
y_pix_siz = sys_rec.y_pixel[meas_ptr->obj_num] ; 

horiz_wind = 

( (meas_ptr->is_window && meas_ptr->meas edge. wind. type 
= HORIZ WIND) ^ ~ 

IT ( l meas_ptr->is_window & & meas jptr->gate [ 0 ] . type — 
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HORIZ_GATE) ); 

/* set edge to dummy value to keep compiler from issuing 
warning message */ 
edge = NULL; 

least_sqr( coords, *count, slope, y_intercept, edge, firms, 
FALSE); 

if (!PURGB_0N) 
return (0); 

if (rms <== TIGHT_RMS) { 

/* 

DEBUG3 ( n FIT_LINE: quick return, rms = %.2f, m,b = %8.5f 

%8.3f», 

rms, *slope, 

*y_intercept) ; 
*/ 

return (0); 

} 

if (rms <= L00SE_KMS) { 

verify_line( coords, *count, *slope, *y_intercept, 
fcvfyjpct) ; 

if ( vf y_pct >= TIGHT_VFY) { 

/* 

DEBUG4 ( " FIT_LINE : quick verify, rms = %.2f vfy = 
%.2f, m,b = %8.5f %8.3f w , 

rms, vfy_j>ct, *slope, 

*y_intercept) ; 
*/ 

return (0) ; 

} 

} 

/* Normalize the pointers returned from malloc- (They 
probably 

are already, but better safe than sorry.) Since we know 

that 

the "edge" and "hist" arrays are less than 64k, we can 

safely 

use short arithmetic on pointers into these structures. 

(I.e., 

we can declare pointers to them M far n .) */ 

edge_alloc = malloc (4*sizeof (int)*MAX_COORDS) ; 
if (edge_alloc — NULL) { 

display^ error ( W FIT_LINE: Not enough memory. Unable to fit 

line."); 

return (-1) ; 

seg = FP_SEG(edge_alloc) ; 
ofs = FP_OFF(edge_alloc) ; 

long_addr = (((unsigned long) seg) « 4) + ofs; 
seg = (tinsigned int) (long_addr » 4) ; 
ofs - (unsigned int) (long_addr & OxF) ; 
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edge - (int far (*) [4] )(( (unsigned long)seg«l6) j of s) ; 

hist alloc = malloc(sizeof (struct hnode) *MAX COORDS); 
if (hTst_alloc — NULL) { " ' 

display_error ("FITJLINE: Not enough memory. Unable to fit 

line. 11 ); 

free( (void *)edge_alloc) ; 
return (-1); 

} 

seg = FP_JSEG(hist_alloc) ; 
ofs = FP_OFF(hist_alloc) ; 

long_addr » (((unsigned long) seg) « 4) + ofs; 
seg = (unsigned int) (long_addr » 4) ; 
ofs = (unsigned int) (long_addr & OxF) ; 

hist_alloc = (struct hnode far *) ( ( (unsigned long)seg«16) 
! ofs); 

quant ize_edge (coords, *count f edge) ; 
expect ed_slope= 0.0; 

slope__search (coords, *count, expected_slope, edge); 

least_sqr (coords, *count, slope, y_intercept, edge, &rms, 
TRUE) ; 

verify_line( coords, *count, *slope, *y_intercept, &vf y_pct) ; 

free ((void *)edge_alloc) ; 
free ((void *)hist_alloc) ; 

if (rms <= LOOSE_RMS) { 

if ( vf y_pct >= TIGHT_VFY) 
rc = 0; 

else if (vf y_pct >= LOOSE_VFY) 

rc = 0; /* set rc to 0 for now 

*/ 

else 

rc = 2; 

} else { 
rc « 2; 

} 

/* 

DEBUG4 ( n PIT_LINE : fitted line, rms = %.2f vfy = %.2f, m,b 
= %8.5f %8.3f w , 

rms, vfy_pct, *slope, 

*y_intercept) ; 
*/ 

return (rc) ; 

} 

/*****************************************************^ 
******** 

quantize_edge() — Calculate the integer X, Y pixel values of 



WO 92/1 1609 



PCT/US91/09477 



18 

each 

edge point and stuff it in edge array. 

inputs: coords [] [2] — floating point edge data 

count — length of coords[][2] (and edge[][4]) 

edge [ ] [4] — dynamically allocated companion array 

for edge data 

outputs: edge[i][0] — X pixel value for coords [i][0] 
edge[i][l] — Y pixel value for coords[i][l] 
edge[i][2] — y- intercept for edge point i 
edge[i][3] — flag word for edge point i 

*********************************************** 
********/ 

quant ize_edge (coords , count , edge) 
double coords[][2J; 
int count; 
iht edge[][4]; 

{ 

int i; 

double x_start, y_start; 

double inv_x_pix_siz, inv_y_j>ix_siz ; 

x_start = meas_j>tr->meas_edge . wind . x_start ; 
y_start = meas_ptr->meas_edge • wind • y_start ; 
inv_x_pix_siz ■ 1.0/x_pix_siz; 
inv_xj>ix_siz = l.O/y_pix_siz; 

/* if horizontal window, X and Y have been swapped */ 
if (horiz wind) { 

for (1=0; i<count; i++) { 

edge[i] [0] = -floor(0.5 + ■ 
coords [i] [0] *inv_y_pix_siz ) ; 

edge[i][l] = floor(0.5 + 

coords[i] [l]*inv_xj>ix_siz) ; 

edge[i][0] += Y — CENTER - y_start; 
edge[i][l] -H= X_CENTER - x_start; 

} 

y else { 

~ for(i=0; Kcount; i++) { 

edge[i] [0] = floor (0.5 + 

coords [ i] [ 0 ] *inv_x_pix_siz) ; 

edge[i][l] = -floor(0.5 + 
coords[i] [l]*inv_y__pix_siz) ; 

edge[i] [0] += X_CENTER - xstart; 
edge[i] [1] += YjCENTER - y_start; 

} ' 

> 

return (0) ; 



WO 92/1 1609 



PCT/US91/09477 



19 



/************************************************************* 
******** 

calc_f itsums() — calculate sums and sums of products needed for 
least 

square line fitting. 

This routine assumes that coords [i][0] is the X value, and 
coords[i][l] 

is the Y value. In fact, the coordinates may have been flipped 
prior to 

the call, but it is up to the calling routine to account for 
that. 

************************************************************** 
*********/ 

calc_fitsums_new( count, coords, edge, x_sum, y_sum, x2_sum, 
y2_sum, 

xy_sum, n, 

select) 

int count, *n, select; 
int edge[][4]; 
double coords [ ] [ 2 ] ; 
double *x_sum, 

*Yjsum, 

*x2_sum, 

*y2_sum, 

*xy_sum; 

{ 

int i; 

double x, y; 
*n = 0; 

*x_sum = *y_sum = *x2_sum= *y2_sum = *xy sum =0; 
if (select) { 

for (i=0; i<count; i++) { 
if (!edge[i][3]) { 

*x_sum += (x=coords[i] [0]) ; 

*x2_sum += x*x; 

*y_sum +« (y=coords[i] [1]) ; 

*y2_sum += y*y; 

*xy_sum += x*y; 

(*n)++; 

} 

} 

} else { 

for (i=0; i<count; i++) { 

*x_sum += (x=coords [ i ] [ 0 ] ) ; 

*x2_sum += x*x; 

*y_sum += (y=coords[i] [1]) ; 

*y2_sum += y*y; 

*xy_sum += x*y; 

(*n)++; 

} 
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return (0); 

} 

/**********************************************^^ 
******** 

least_sqr() — routine to perform a least squares line fit to 
the 

qualified edge points. 

This routines assumes that coords [i][0] is the X value and 
coords [i][l] 

is the Y value, and that it is fitting a horizontal line to the 
data. In 

fact, the X and Y data could have been flipped if it came from 
a horizontal 

window. It is up to the calling program to account for that. 

CAUTION: This program will blow up if the line is oriented the 
wrong way. 

A least squares fit based on y«mx+b will try to minimize 
the errors 

in y of the fitted line and this will become wildly 
erratic if the 

line approaches the vertical. 

For now, I've flipped the algorithm to base it on x==my+b 

********************************************************* 
********/ 

least_sqr (coords , count, slope, y_intercept, edge, rms, select) 
double coords [ ] [2 ] , 

*slope, 

*y_intercept , 

*rms; 
int count, 

select; 
int edge[][4]; 

{ 

double x_sum, 

y_sum, 

x2_sum, 

y2_sum, 

xy_sum, 

temp, 

dev_sq; 
int n; 



calc_f itsums_new ( count , coords, edge, &x_sum, &y_sum, 
&x2_sum, &y2_sum, &xyjsum, to, select); 

/* We should never see temp=0. About the only way for this 
to occur is 
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if all of the points are thrown out and n=0. (This should 
not happen 

either,) In any event, a little defensive programming 

seems 

worthwhile. */ 

temp = n * x2_sum - x_sum * x_sum; 
if (temp=0.0 |! n=0) { 

*slope =0; 

*y_intercept « 0; 

*rms = 1000; /* make sure line is thrown out 

*/ 

} else { 

*slope = (n * xy_sum - x_sum * y_sum) /temp; 
*y_intercept = (x2_sum * y_sum - x_sum * xy_sum) / temp; 
dev_sq = y2_sum - *y_intercept * y_sum - *slope * xy_sum; 

*rms = sqrt(dev_sq/n) ; 

} 

if (horiz_wind) 

*rms = *rms/x_pix_siz; 

else 

*rms = *rms/yjpix__siz ; 
return (0); 

} 



/************************************************************* 
******** 

verify_line — calculate how many of the edge points meet the 
verification criterion. 

************************************************************** 
********/ 

verify_line( coords, count, m, b, vfyjpct) 

int count; 

double coords [ ] [2 ] , 

m, 

b, 

* vfy_pct; 

{ 

double tolerance; 
int i, vf y_count ; 

vfy_count = 0; 

if (horiz_wind) 

tolerance = x_pix_siz * VERIFY_DISTANCE ; 

else 

tolerance = y_pix_siz * VERIFY_DISTANCE; 

for (i*=0; i<count; i++) { 

if (fabs((m * coords[i][0] + b) - coordsfi] [1] ) < 
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tolerance) 

vfy_count++; 

} 

if (horiz_wind) 

* v f y _ p c 
(double) vf y_count/meas_ptr->meas_edge. wind. delta_y ; 

else 

* v f y _ p c 
(double) vf y_count/meas_j>tr->meas_edge. wind. delta_x; 

return (0) ; 



/******************************************************^ 
******** 

histogram () — accumulates histogram data. Called once for each 
value 

entered into the histogram, 
inputs: value — the value to be accumulated 

************************************************************** 

********/ 

histogram (value) 

int value; 

{ 

struct hnode *hnew, *hprev; 

if (value = hptr->value) { 

hptr->count-H- ; 
} else if (value < hptr->value) { 

for(;;) { /* scan left */ 

if (hptr->left = NULL) { 

hnew = (struct hnode far * ) hist_f ree++ ; 
hptr->left = hnew; 
hnew->left = NOLL; 

hnew->right = hptr; /* add node at left end 

hnew->value = value; 
hnew->count = 1; 
hptr = hhead = hnew; 
break; 
} else { 

hptr = hptr->left; 
if (value = hptr->value) { 
hptr->count++ ; 
break; 

} else if (value < hptr->value) { 

continue; 
> else { 



*/ 
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hnew = (struct hnode far *)hist_free++; 

hprev = hptr->right; 

hptr->right - hprev->left = hnew; 

hnew->left ■ hptr; 

hnew->right = hprev; 

hnew->value = value; 

hnew->count =1; 

hptr = hnew; 

break; 

} 

} 

} 

} else { 

for(;;) { /* scan right */ 

if (hptr->right — NULL) { 

hnew = (struct hnode far *)hist_free++; 
hptr->right = hnew; 
hnew->right = NULL; 

hnew->left - hptr; /* add node at right end 

*/ 

hnew->value = value; 
hnew->count = 1; 
hptr = htail = hnew; 
break; 
} else { 

hptr = hptr->right; 

if (value «= hptr->value) { 

hptr->count++ ; 

break; 

} else if (value > hptr->value) { 

continue; 
} else { 

hnew = (struct hnode far * ) hist_f ree++ ; 

hprev = hptr->lef t ; 

hptr->left = hprev->right = hnew; 

hnew->left = hprev; 

hnew->right = hptr; 

hnew- > value = value; 

hnew->count =1; 

hptr = hnew; 

break; 

} 

} 

} 

} 

return (0) ; 

} 



/************************************************************* 
******* 
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match_slope() — fits a test line of the specified slope through 
each 

of the edge points and accumulates a histogram of the 
y intercepts 

of the lines. If the line in the image has the same 
slope as the 

test line, then the histogram will exhibit a large peak 

marking 

the location of the line. This routine returns the value 

(in 

number of pixels) of the highest peak in the current 
histogram. 

inputs; coords [] [2] — raw edge data 

count — count of edge points in coords [ ] [ ] and 

edge[]n 

slope — slope of test line 

edge[][4] — processed edge data and flags 

mark — tells whether to mark edge[][] flags 

(T/F) 

outputs: num — number of pixel in max bin of 

histogram 

************************************************* 
********/ 

match_slope (coords , count, slope, edge, num, mark) 
double coords [] [2], 

slope; 
int count, *num; 
int edge[][4]; 

double pix_slope; 

int (*e_ptrl) [4] , (*e_j>tr2) [4] ; /* pointers for edge[] [4] 
array */ 

int i, lowerjtimit, upper_limit, max; 
int bin_count, right_count, left_count; 

struct hnode *hmax, *r_hptr, *l_hptr; 

^initialization for histogram */ 
hist_free = hist_alloc; 

hptr = hhead = htail = (struct hnode far * ) hist_f ree++ ; 
hptr~>right = hptr->left = NULL; 

hptr->value =0; /* these two create a 

null node */ 

hptr->count = 0; /* may want to handle 

differently */ 



/************************************************************** 
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algorithm to compute y_int[] array using edge[][4] data. 

This 

requires that the edge data be calculated, but then is 

quicker 

for subsequent passes. 

(Note: Coding this loop in assembly language will 
substantially 

speed up the line searching algorithm. The 



quickest 
to 
and 
be 

) 



way to do it would be to set the 80387 for round 
nearest mode outside the loop, execute the loop, 
reset the 80387 to its previous state. This will 
MUCH faster than adding 0.5 and calling floor(). 



Note that we must invert the sign of slope since the 
positive Y 

sense flips when we go from stage (micron) coordinates to 

pixel 

coordinates • 
*********************************************** 

/* compute y_int for each edge point and quaint ize it */ 
if (horiz_wind) { 

pix_slope = -slope * (y_pix_siz/x_pix_siz) ; 
} else { 

pix_slope = -slope * (x_pix siz/y pix siz) ; 

* 

e_ptr2 = edge + count; 

for (e_ptrl=edge; e_ptrl<e_ptr2 ; ejptrl++) { 
histogram( (*e_ptrl)[2] = 

floor(0.5 + (*e_ptrl) [1] - pix_slope * (*e_j>trl) [0]) 



/* find bin with largest number of edge points */ 
max =0; 

for (hptr=hhead; hptr!=NULL; hptr=hptr->right) { 
if (hptr->count > mauc) { 
max = hptr->count; 
hmax = hptr; 

} 

} 

*num = max; /* return to calling program */ 



/************************************************************* 

Updated bin selection: 
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Select max bin plus enough adjacent bins to include at least 
SELECTION_PCT of edge points. 
*************************************************** 



if (mark) { 

bin_count = max; 

r_hptr = l_hptr = hmax; 

lower_limit = upper_limit = hmax->value; 

for (;;) { 

if (binjcount > SELECTION_PCT * count) 
break; 

if (l_hptr->left != NULL) 

left_count = l_hptr->left->count; 

else 

left_count =0; 

if (r hptr->right != NULL) 

rTght_count = r_hptx->right->count; 

else 

right_count =0; 



if (right count > left_count) { 
' if (rxght_count < 0 . 1 * count) 

break; 
r_hptr = r_hptr->r ight ; 
upper_limit = r_hptr->value; 
bin_count -h= r_hptr->count; 

} else { 

if (left_count < 0.1 * count) 

break; 
l_hptr = l_hptr->left; 
lower_limit = l_hptr->value; 
bin_count += l_hptr->count ; 

} ' 

} 

/* initialize all points to good */ 
for (i=0; i<count; i++) 
edge[i][3) = 0; 

/* mark bad edge points */ 
for (i=0; i<count; i++) { 

if (edge[i][2] < lower_limit {J edge[i][2] > 
upper limit) { 

edge[i][3] j= BAD_Y_INT; 
if (i > 0) 

edge[i-l][3] }= BAD_Y_INT; 
if (i < count-1) 

edge[i+l][3] |= BAD_Y_INT; 
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} 

} 

} 

return (0) ; 

} 



/************************************************^^ 
******** 



slope_search() — conduct search for a line using match slope 
routine, "* 

inputs: coords [] [2] — raw edge data 

count — count of edge points in coords [ ] [ 1 
and edge[][] 

expected_slope — expected slope of line 

edge[][4] — processed edge data and flags 

************************************************************** 
********/ 

slope search (coords, count, expected_slope, edge) 
double coords [] [2], 

expect ed_s lope ; 
int count; 
int edge[][4]; 
{ 

int done[2] ; 

double start ang, slope; 
int dir; 

int num, max, i_max[2], limit[2]; 



start_ang = at an ( expect ed_s lope) ; 

match_slope ( coords , count, expected slope, edge, &num, 
FALSE); 

max = num; 

/* arbitrarily start search to the left */ 
slope = tan(start_ang - ANG_INC) ; 

match_slope (coords, count, slope, edge, &num, FALSE) ; 
if (num > max) { 
max = num; 

i_max[LEFT] = i_max [RIGHT] = -1; 

dir - LEFT; 
} else if (num < max) { 

i^max[LEFT] = ijnax [RIGHT ] =0; 

dir = RIGHT; 
} else { 

i_max[LEFT] = -1; /* num = max */ 

i max [RIGHT] = 0; 
dir = LEFT; 

} 
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limit[LEFT] - -1; /* limit left */ 
limit [RIGHT] = 0; /* limit right */ 

dir = LEFT; 

done [LEFT] = done [RIGHT] = FALSE; 
while ( ! done [LEFT] || Idone[RIGHT] ) { 

switch (dir) { 
case LEFT: 

if (done [LEFT]) continue; 

if (limit [LEFT] * ANG_INC <= -ANG_MAX) { 

done [LEFT] = TRUE; 

dir = RIGHT; 

continue; 
} else { 

limit [LEFT] -= 1; 

} 

slope = tan(start_ang + limit [LEFT] * ANGJCNC) ; 
match_slope (coords , count, slope, edge, &num, FALSE) ; 

if (num > max) { 

max = num; 

i_max[LEFT] = i_max [RIGHT] = limit [LEFT] ; 

} else if (num — max) { 

i_max[LEFT] = limit [LEFT]; 

} 

if (abs ( i_max[LEFT] - limit [LEFT] ) > LIMIT_TEST) { 
done [LEFT] = TRUE; 
dir = RIGHT; 

} 

break; 

case RIGHT: 

if (done [RIGHT]) continue; 

if (limit [RIGHT] * ANG_INC >= ANGJiAX) { 

done [RIGHT] = TRUE; 

dir = LEFT; 

continue; 
y else *{ 

" limit [RIGHT] -h= 1; 

} 

slope = tan(start_ang + limit [RIGHT] * ANG_INC) ; 
match_slope (coords, count, slope, edge, &num, FALSE) ; 

if (num > max) { 
max = num; 

i_max [ RIGHT ] = i_max[LBFT] = limit [RIGHT] ; 
} else if (num = max) { 

i_max[ RIGHT] = limit [RIGHT] ; 

> 
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if (abs(i_max[RIGHT] - limit [RIGHT]) > LIMIT_TEST) { 
done [RIGHT] = TRUE; 
dir = LEFT; 

} 

break; 

} 

} /*** end of while (! done [LEFT] J| ! done [RIGHT] ) ***/ 

/* call match_slope one last time to mark edge[] [] flags */ 
slope = tan (starting + i_max[LEFT] * ANG_INC) ; 

match_slope (coords , count, slope, edge, &num, TRUE); 

return (0) ; 
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WHAT IS CIAIMED IS: 

1 # A method of detecting collinear edge 
points in a digitized image comprising the steps of: 
5 a) capturing an image of an object; 

b) digitizing the captured image to generate 
an ordered set of pixel values; 

c) identifying a set of edge points from the 
ordered set of pixel values; 

10 d) setting a trial slope equal to an expected 

slope value; 

e) for each one of said identified edge 
points , computing an intercept value of a straight line 
passing through the identified edge point and having a 

15 slope equal to the trial slope; 

f ) accumulating a count of identified edge 
points associated with the computed intercept value and 
the trial slope; 

g) varying the expected slope by an amount 
20 corresponding to a predetermined angular increment to 

generate a new trial slope; 

h) repeating steps e) and f ) for the new 
trial slope to generate a plurality of accumulated 
counts f each accumulated count being associated with a 

25 slope/intercept pair; 

i) comparing the accumulated counts of 
identified edge points to identify a best slope/ intercept 
pair associated with the maximum count of identified edge 
points; and 

30 j) selecting a collinear subset of the set of 

edge points by determining which ones of the identified 
edge points are on a straight line defined by the best 
slope/ intercept pair. 
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2. The method of claim 1 wherein step g) of 
varying the expected slope comprises: 

determining a start-angle associated with the 
expected slope; 

5 incrementing the start-angle by a predetermined 

increment; and 

calculating the tangent of the incremented 
start-angle. 

10 3. The method of claim 2 further comprising 

the step of repeating steps g) and h) until a 
predetermined test is satisfied. 

4. The method of claim 3 wherein step k) 
15 comprises generating a line by finding a least squares 

line fit for the selected subset of points. 

5. The method of claim 3 wherein the step e) 
of computing an intercept value comprises the step of 

20 computing a y-intercept value. 

6. The method of claim 3 wherein: 

step i) comprises the step of identifying a 
best slope/ intercept pair having a best slope and a best 
25 intercept; and 

step j) comprises the steps of: 

calculating, for each of said identified 
edge points, the intercept value of a straight 
* line having a slope equal to the best slope and 

30 passing through said identified edge point; and 

comparing each of the calculated intercept 
values to a range of values including the best 
intercept. 



WO 92/1 1609 



32 



PCT/US91/09477 



7. A method of measuring the distance between 
two edges on an object Comprising the steps of: 

a) capturing an image of the object; 

b) digitizing the captured image to generate 
an ordered set of pixel values; 

c) identifying a first set of edge points 
corresponding to a first edge from the ordered set of 
pixel values; 

d) setting a trial slope equal to an expected 
slope value; 

e) for each one of said identified edge 
points, computing an intercept value of a straight line 
passing through the identified edge point and having a 
slope equal to the trial slope; 

f ) accumulating a count of identified edge 
points associated with the computed intercept value and 
the trial slope; 

g) varying the expected slope by an amount 
corresponding to a predetermined angular increment to 
generate a new trial slope; 

h) repeating steps e) and f) for the new 
trial slope to generate a plurality of accumulated 
counts, each accumulated count being associated with a 
slope/intercept pair; 

i) comparing the accumulated counts of 
identified edge points to identify a best slope/intercept 
pair associated with the maximum count of identified edge 
points ; 

j) selecting a collinear subset of the first 
set of edge points by determining which ones of the 
identified edge points are on a straight line defined by 
the best slope/ intercept pair; 

k) using the selected subset of the first set 
of edge points to generate a first line; 



WO 92/1 1609 



- 33 - 



PCT/US91/09477 



1) repeating steps a) through k) for a second 
set of edge points corresponding to a second edge to 
generate a second line; and 

m) determining a distance between the first 
5 line and the second line. 



8. The method of claim 7 wherein step g) of 
varying the expected slope comprises: 

determining a start-angle associated with the 
10 expected slope; 

incrementing the start-angle by a predetermined 
increment; and 

calculating the tangent of the incremented 
start-angle. 



15 



9. The method of claim 8 further comprising 
the step of repeating steps g) and h) until a 
predetermined test is satisfied. 



10. The method of claim 9 wherein step k) 
comprises generating a line by finding a least squares 
line fit for the selected subset of points. 

11. The method of claim 9 wherein the step e) 
of computing an intercept value comprises the step of 
computing a y-intercept. 

12. The method of claim 9 wherein: 
step i) comprises the step of: 

identifying a best slope/ intercept pair 
having a best slope and a best intercept; and 
step j) comprises the steps of: 

calculating, for each of said identified 
edge points, the intercept value of a straight 
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line having a slope equal to the best slope and 
passing through said identified edge point; and 
comparing each of the calculated intercept 
values to a range of values including the best 
5 intercept. 

13. An apparatus for measuring the distance 
between two edges on an object comprising: 

a camera for capturing an image of the object; 
10 means coupled to said camera for digitizing the 

captured image to generate an ordered set of pixel 
values; and 

image processing means coupled to said 
digitizing means for receiving and analyzing the ordered 
15 set of pixel values by: 

a) identifying a first set of edge points 
corresponding to a first edge from the ordered 
set of pixel values; 

b) setting a trial slope equal to an expected 
20 slope value; 

c) for each one of said identified edge 
points, computing an intercept value of a 
straight line passing through the identified 
edge point and having a slope equal to the 

25 trial slope; 

d) accumulating a count of identified edge 
points associated with the computed intercept 
value and the trial slope; 

e) varying the expected slope by an amount 
30 corresponding to a predetermined angular 

increment to generate a new trial slope; 

f) repeating steps c) and d) for the new 
trial slope to generate a plurality of 
accumulated counts, each accumulated count 

35 being associated with a slope/intercept pair; 
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g) comparing the accumulated counts of 
identified edge points to identify a best 
slope/ intercept pair associated with the 
maximum count of identified edge points; 
5 h) selecting a collinear subset of the first 

set of edge points by determining which ones of 
the identified edge points are on a straight 
line defined by the best slope/intercept pair; 
i) using the selected subset of the first set 

10 of edge points to generate a first line; 

j) repeating steps a) through i) for a second 
set of edge points corresponding to a second 
edge to generate a second line; and 
k) determining a distance between the first 

15 line and the second line. 

14. The apparatus of claim 13 wherein said 
image processing means includes means for analyzing the 
ordered set of pixel values by varying the expected slope 

20 by: 

determining a start-angle associated with the 
expected slope; 

incrementing the start-angle by a predetermined 
increment; and 

25 calculating the tangent of the incremented 

start-angle. 

15. The apparatus of claim 14 wherein said 
image processing means includes means for analyzing the 

30 ordered set of pixel values by varying the expected slope 

and comparing the accumulated counts until a 
predetermined test is satisfied. 



* 

35 



16. The apparatus of claim 15 wherein said 
image processing means includes means for analyzing the 
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ordered set of pixel values by using the selected subset 
of points to generate a line by finding a least squares 
line fit for the selected subset of points. 

17 . The apparatus of claim 15 wherein said 
image processing means includes means for analyzing the 
ordered set of pixel values by: 

comparing the accumulated counts to identify a 
best slope/intercept pair having a best slope and a best 
intercept; and 

selecting a collinear subset by calculating, 
for each of said identified edge points, the intercept 
value of a straight line having a slope equal to the best 
slope and passing through said identified edge point and 
compearing each of the calculated intercept values to a 
range of values including the best intercept. 

18. The apparatus of claim 15 wherein said 
image processing means comprises a programmed digital 
computer. 
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